Papers with nuanced composition
Assessing Phrasal Representation and Composition in Transformers (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for deep transformers are able to combine word meanings into phrase meanings, but they lack a clear understanding of how they handle complex linguistic inputs. |
| Approach: | They propose to analyze phrasal representations in pre-trained transformers to determine whether they reflect sophisticated composition of phrase meaning. |
| Outcome: | The proposed models are able to combine meaning units into larger units, a phenomenon known as composition, and reflects human understanding of meaning. |